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Abstract 

We present a parallel approximation algorithm for a class of mixed packing and covering 
semidefinite programs which generalize on the class of positive semidefinite programs as con- 
sidered by Jain and Yao |6|. As a corollary we get a faster approximation algorithm for positive 
semidefinite programs with better dependence of the parallel running time on the approxima- 
tion factor, as compared to that of Jain and Yao ||6). Our algorithm and analysis is on similar 
lines as that of Young |[T0l who considered analogous linear programs. 

1 Introduction 

Fast parallel approximation algorithms for semidefinite programs have been the focus of study 
of many recent works (e.g. HJEHZHSSlEl) an d have resulted in many interesting applications 
including the well known QIP = PS PACE [3] result. In many of the previous works, the run- 
ning time of the algorithms had polylog dependence on the size of the input program but in 
addition also had polynomial dependence of some width parameter (which varied for different 
algorithms). Sometimes (for specific instances of input programs) the width parameter could 
be as large as the size of the program making it an important bottleneck. Recently Jain and 
Yao [6) presented a fast parallel approximation algorithm for an important subclass of semidef- 
inite programs, called as positive semidefinite programs, and their algorithm had no dependence 
on any width parameter. Their algorithm was inspired by an algorithm by Luby and Nisan (8) 
for positive linear programs. In this work we consider a more general mixed packing and covering 
optimization problem. We first consider the following feasibility task Ql. 

Ql: Given n x n positive semidefinite matrices P\, . . . , P m , P and non-negative diagonal ma- 
trices C\, . . . , C m , C and e e (0, 1), find an ^-approximate feasible vector x > such that (while 
comparing matrices we let >, < represent the Lowner order), 

m m 

Yj x i p i < (1 + £)P and ]T) x,Q > C 

i=l i=\ 
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or show that the following is infeasible 

m m 

) £ XiPi < P and Yj *i'Q — C . 

!=1 i=l 

We present an algorithm for Ql running in parallel time polylog(n, m) ■ \ ■ log |. Using 
this and standard binary search, a multiplicative (1 — e) approximate solution can be obtained 
for the following optimization task Q2 in parallel time polylog(n, m) ■ i ■ log |. 

Q2: Given n x n positive semidefinite matrices P\, . . . , P m , P and non-negative diagonal matri- 
ces C\, . . . , C m , C, 

maximize: 7 

m 

subject to: Y\ x i^i _• P 
i=l 

m 

;=1 

Vi G [w] : x; > 0. 

The following special case of Q2 is referred to as a positive semidefinite program. 

Q3: Given n x n positive semidefinite matrices Pi, ... , P m , P and non-negative scalars C\,..., c m , 

m 

maximize: x,c ; 

H! 

subject to: Y] XjPi < P 

i=\ 

Mi e [w] : x ; - > 0. 

Our algorithm for Ql and its analysis is on similar lines as the algorithm and analysis of 
Young [ 10 [ who had considered analogous questions for linear programs. As a corollary we get 
an algorithm for approximating positive semidefinite programs (Q3) with better dependence 
of the parallel running time on £ as compared to that of Jain and Yao [6| (and arguably with 
simpler analysis). Very recently, in an independent work, Peng and Tangwongsan [9| also pre- 
sented a fast parallel algorithm for positive semidefinite programs. Their work is also inspired 
by Young |l0l. 

2 Algorithm and analysis 

We mention without elaborating that using standard arguments the feasibility question Ql 
can be easily transformed, in parallel time polylog(mn), to the special case when P and C are 
identity matrices and we consider this special case from now on. Our algorithm is presented 
in Figured] • 

Idea of the algorithm 

The algorithm starts with an initial value for x such that Y^=\ x iPi < 1- It makes increments 
to the vector x such that with each increment, the increase in || X^^Li x iPi\\ is n °t more than 
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(1 + 0(e)) times the increase in the minimum eigenvalue of Y^fLi *tQ- We argue that it is 
always possible to increment x in this manner if the input instance is feasible, hence the algo- 
rithm outputs infeasible if it cannot find such an increment to x. The algorithm stops when the 
minimum eigenvalue of E!=i x i'Q has exceeded 1. Due to our condition on the increments, at 
the end of the algorithm we also have Y^—\ x i^i — (1 + ^ ( e ) We obtain handle on the largest 
and smallest eigenvalues of concerned matrices via their soft versions, which are more easily 
handled functions of those matrices (see definition in the next section). 



Input : n x n positive semidefinite matrices P\, . . . , P m , non-negative diagonal matrices Q, . . . , C m , and 
error parameter e G (0,1). 

Output : Either infeasible, which means there is no x such that (1 is the identity matrix), 

m m 

E XjPj < 1 and ]T) XjCi > 1 . 



i=l 



OR an x* 6 W such that 



E x *i p i < (1 + 9e)l and £ x*Q > 1 

/=i i=i 



1. Setx 



l 



1 m\\P, 



2. SetN= |(||n'ii x i- p ill+ 2m " + lnm )- 

3. While h min (Y™ =1 XiCj) < N (\ m m represents minimum eigenvalue), do 

(a) Set 

Tr(exp(E;i 1 x,P,)-P ; ) 
local, (x) = =r-, — — — -ttt and 



global(x) 



Tr(exp(-E;'i 1 XiCi)-Cj) 

Trexp(ET=i XjPj) 
Tr(exp(-IXi*iQ))' 



(b) If g is not yet set or min^ jlocaL^x)} > g(l + e), set g = global(x). 

(c) If miny{localy(x)} > global(x) , return infeasible. 

(d) For all / G [m], set Cj = Tlj ■ Cj ■ Tlj, where IL is the projection onto the eigenspace of Y%L\ *iQ 
with eigenvalues at most N. 

(e) Choose increment vector a > and scalar 5 > such that 

V/ : ctj = XjS if locaL(x) < g(l + e), else ctj — 0, and 



E a < p < 

i=i 



E a ' c ' 
i=i 



(f) Set x = x + a. 
4. Return x* = x/N. 



Figure 1: Algorithm 
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Correctness analysis 

We begin with the definitions of soft maximum and minimum eigenvalues of a positive semidef- 
inite matrix A. They are inspired by analogous definitions made in Young 1101 in the context 
of vectors. 

Definition 1. For positive semidefinite matrix A, define 

Imax(A) = InTr exp(A), 

and 

Imin(A) = - lnTrexp(-A). 

Note that Imax(A) > || A|| and Imin(A) < A m j n (A), where A m j n (A) is the minimum eigen- 
value of A. 

We show the following lemma in the appendix, which shows that if a small increment is 
made in the vector x, then changes in Imax(Eyli x jAj) anc ^ I mm (Eyli x jAj) can ^ e bounded 
appropriately. 

Lemma 2. Let A\,..., A m be positive semidefinite matrices and let x > 0, a > be vectors in R m . If 
\\L?= i <*i Ai || < e < 1, then 

lmaxC£(x j + ocj) A j) -Imax( jjx/Ay) < Tr ( exp ( g H_ i XjA ^ E a ; Tr ( ex P(E x i A i)Aj), 

and 

m m f-i _ £ /2) '" m 

Jxmn(£(xj + ttj)Aj) - Imin(£ xyAy) > Tr(exp (_ E ^ i X . A .)) E a ; Tr (exp(- E^)^/)- 

Lemma 3. At step 3(e) o/f/je algorithm, for any j with a.; > Owe have, 

Tr(exp(Ef =1 x,-Py)-Py) Tr(exp(- *«Q) ; 9) 

Tr(exp(E™i^)) " l J Tr(exp(-E^x ; -Q)) ' 

Proof. Consider any execution of step 3(e) of the algorithm. Fix j such cij > 0. Note that, 

locals) _ Tr(exp(E?ii ■ Pf) ■ Tr(exp(- E^i *,-Q)) 
global(x) Tr(exp(E™i " Tr(exp(- Ef =1 x,-Q) ■ Cy) " 

We will show that global(x) > g throughout the algorithm and this will show the desired since 
thatlocah(x) < (l + e)g< (1 + e)global(x). 

At step 3(b) of the algorithm, g can be equal to global(x). Since x never decreases during 
the algorithm, at step 3(a), global(x) can only increase. At step 3(d), the modification of Cys 
only decreases Tr(exp(— Y4L1 */Q)) and hence again global(x) can only increase. □ 

Lemma 4. For each increment of x at step 3(f) of the algorithm, 

m m j m m \ 

Imax(^(xy + ocAPj) — Imax(J^ XyPy) — (1 + £ ) 3 Iniin(^(xy + «y)Cy) — Imin(J^ XiCj) I . 
;=1 ;=1 V ;=1 ;'=1 / 
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Proof. Consider, 

m m 

Imax(^(xj + 0Cj)Pj) — Imax( y~] XjPj) 
7=1 /=i 

Cl + m - 

" ^(expW =1 x f P f )) jg Tr(6Xp( fi ^ (fr ° m LemmaE) 

(1 + e) 2 "' '" 

< =—, ■ — =A — rr- 2j a j Tr(exp(— x iQ)Cj) (from Lemma|3]and step 3(e) of the algorithm) 



< 



Tr(exp(-Er=i*iQ)) ; tl 7 v ^ ,tl" 

(1 + e) 2 / m m \ 

)■ j- lmin(Y^(xj + a.j)Cj) — Imin(^ XjCj) (from Lemma |2j. 

1-6/2 V ;=l ;=l / 



This shows the desired. □ 

Lemma 5. If the input instance Pi, ... , P m , C\,...,C m is feasible, that is there exists vector y £ M m 
such that 

m m 

Yj Vi p i <^ and Y xjiQ > 1 , 

i=l i=l 

then always at step 3(c) of the algorithm, min^{locaL(x)} < global(x). Hence the algorithm will 
return some x*. 

If the algorithm outputs infeasible, then the input instance is not feasible. 

Proof. Consider some execution of step 3(c) of the algorithm. Let C[,. . .,C' m be the current 
values of Ci, . . . , C m . Note that if the input is feasible with vector y, then we will also have 

Tr(exp(E;iiX i fi)(Ef = iy ; P;)) Tr(exp(-i:r =1 x,C;)(Ef = iy / q)) 
Tr(exp(ET = i^)) " " Tr(exp(-Er=i*tC<)) 

Therefore there exists j G [m] such that 

Tr(exp(ET =1 x ! P I )P / ) < Tr(exp(-E£i*fC0q) 



Tr(exp(E™iX,P ! )) " Tr(exp(- ET=i *C$) ' 



and hence locaL(x) < global(x). 

If the algorithm outputs infeasible, then at that point miny{local^(x)} > global(x) and 
hence from the argument above Pi, ... , P m , C[, . . . , C' m is infeasible which in turn implies that 
Pi, ... , P„„ Ci, . . . , C m is infeasible. □ 

Lemma 6. If the algorithm returns some x* , then 

m m 

Y x i P i < (1 + 9e )! and E X i C i - 1 - 
i=l i=l 

Proof. Because of the condition of the while loop, it is clear that Ei=i X [*Q -t 1- 
For x 6 R m , define 

m m 

®(x) = Imax(£ XjPj) - (1 + e) 3 ■ Imin(£] XjCj). 

;=1 ;=1 
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Note that the update of Cj's at step 3(d) only increase hxan(Y^Li XjCj). Hence using Lemma|H 
we conclude that <J>(x) is non-decreasing during the algorithm. At step 1 of the algorithm, 

m m 

<E>(x) < Imax(^x / P / ) = lnTr(exp(E x;?,)) 
;=1 i=l 



< ln(« exp( 



E*iP« 



i-i 



)) <ln(«exp(J]||xiP i ||)) = Inn + l. 



Hence just before the last increment, 



1-1 



< Imax(£ x ; -Py) < O(x) + (1 + e) 3 ■ Imin(E XjCj) 
;=1 ;=1 

m 

< In n + 1 + (1 + e) 3 ■ fcnin(]P XjCj) 

7=1 

m 

< Inn + 1 + (1 + £ ) 3 ■ A min (£ XjCj) 

7=1 

< lnn + 1 + (1 + e) 3 N < (1 + 8e)N . 

In the last increment, because of the condition on step 3(e) of the algorithm, 1152=1 %iPi\\ in- 
crease by at most e. Hence E"U x*Pj < (1 + 9e)l. □ 

Running time analysis 

Lemma 7. Assume that the algorithm does not return infeasible/or some input instance. The number 
of times g is increased at step 3(b) of the algorithm is 0(N/ e). 

Proof. At the beginning of the algorithm Tr(exp(— YjLi *iQ)) < n since each eigenvalue of 
ex p( — THL\ *iQ) is at most 1. Also Trexp^-^ x ; -P;) > 1. Hence 

Trexp(E;'l 1 x,fi) 1 1 
g = global (x) = — -, — -^r- > - > 



Tr(exp(-XXi*iQ)) ~ " ~ exp(N)' 
At the end of the algorithm \ m m(L"U *tQ) < N + e < 2N. Hence 



Tr(exp(- ]T *iQ)) > 



i-i 



ex p(- £*/Q) 

1=1 



Also (using Lemma [6]l 



Tr(exp( £>?;)) < n 

i=i 



exp(J3x i P j ; 

1=1 



exp(-A min (E*i'Q)) > exp(-2N). 
i=i 



< nexp((l + 9e)N) < exp(HN). 



Hence g < global(x) < exp(13/V). 

Whenever g is updated at step 3(b) of the algorithm, we have 

global(x) > min{locaL;(x)} > (l + e)g 



just before the update and global(x) = g just after the update. Thus g increases by at least 
(1 + e) multiplicative factor. Hence the number of times g increases is 0(N/e). □ 
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Lemma 8. Assume that the algorithm does not return infeasible/br some input instance. The number 
of iterations of the while loop in the algorithm for a fixed value of g is 0(Nlog(mN)/e). 

Proof. From Lemma|6]and step 3(d) ofthe algorithm we havemax{ || ^"ij X;P/ 1| , ||Di=i *;Q II } — 
O(N) throughout the algorithm. On the other hand we have max{||X^!li $ x iPi II / ||Xw=i fajQ ||} = 
e at step 3(e). Hence S = Cl(e/N) throughout the algorithm. 

Let Xj be increased in the last iteration of the while loop for a fixed value of g. Note that xi 
is initially 1/ (m \\Pj\\) and at the end x; is at most ION / 1 1 Pi 1 1 (since, using Lemma|6l 1 1 x;Pi 1 1 < 
||E™i^f;|| < ION). Hence the algorithm makes at most 0(log(mN)/S) = O (N log(mN) / e) 
increments for each X;. 

Note that locaL(x) only increases throughout the algorithm (easily seen for steps 3(d) and 
3(e) of the algorithm). Hence since the last iteration of the while loop (for this fixed g) increases 
Xj, it must be that each iteration of the while loop increases Xj. Hence, the number of iterations 
of the while loop (for this fixed g) is 0(N\og(mN) /e). □ 

We claim (without further justification) that each individual step in the algorithm can be 
performed in parallel time polylog(mn). Hence combining the above lemmas and using N = 

0(^=1), we get 

Corollary 9. The parallel running time ofthe algorithm is upper bounded by polylog(mn) ■ \ ■ log |. 
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A Deferred proofs 

Proof of LemmaHJ We will use the following Golden-Thompson inequality. 
Fact 10. For Hermitian matrices A, B : Tr(exp(A + £>)) < Tr exp(A) exp(B). 

We will also need the following fact. 
Fact 11. Let A be positive semidefinite with || A \\ < e < 1. Then, 

exp(A) < 1+ (l + e)A and exp(-A) < 1 - (1 - e/2)A. 

Consider, 

m m 

Imax(^(x / - + 0Cj)Aj) — Imax(J^ XjAj) 
j=l j=l 

'Trexp(E™i(*/ + ai )A-y 



In 



TrexpiEf^XiAi) 



^ TrexpCE^x^QexplE^^) ^ 
" ln { Trexp(E- 1 x ; A 1 ) J (from Fact© 

, exp(Ef =1 »A-)(1 +(! + £) (Ef =1 ajAjj) \ 
= Trexp(E- 1 ^ / ) ) i^^m 

f (1 + e) Tr exp(Er = i *A) (Lf =1 ccjAj) \ 

n { + Trexp(Er=i*/A-) ) 

(1 + e) Tr exp(Er=i (E/ti ccjAj) 

< — Wl — — - (since ln(l + a) < a for all real a) 

Tr exp(E != i %iAi) 

The desired bound on Imin(E"li ( x j + a /'M/') — Imin(Eyli x j J ^j) follows by analogous calcula- 
tions. □ 
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